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Abstract. We consider the linear stability problem for a 3D cylindrically 
symmetric equilibrium of the relativistic Vlasov-Maxwell system that describes 
a coUisionless plasma. For an equilibrium whose distribution function decreases 
monotonically with the particle energy, we obtained a linear stability criterion 
in our previous paper |23) . Here we prove that this criterion is sharp; that is, 
there would otherwise be an exponentially growing solution to the linearized 
system. We also treat the considerably simpler periodic l^D case. The new 
formulation introduced here is applicable as well to the nonrelativistic case, to 
other symmetries, and to general equilibria. 



1. Introduction 

We consider a plasma at such high temperature or low density that collisions can 
be ignored compared with the electromagnetic forces. Such a coUisionless plasma is 
modeled by the relativistic Vlasov-Maxwell (RVM) system. We assume all physical 
constants like the speed of light c and the mass of particles m to be 1, for the 
sole purpose of simplifying our notation. All the results we obtain below can be 
modified straightforwardly to apply to the true physical situations with general 
masses, charges, etc. In the physical literature, the nonrelativistic version of the 
Vlasov-Maxwell system is more commonly considered but our results easily extend 
to that case. Our notation is as follows. Let (t, x,v) be the ion and electron 
distribution functions, E(t,a:) and 'B{t,x) be the electric and magnetic fields and 
-^ext^ ^ext ^Yie external fields. Then the RVM system is 

(la) 9t/± + V ■ W^f^ ± (E + E^^^* + VX {B + B"""')) ■ V^,/=^ = 0, 
(lb) dtE = VxB-j, V-E = p, p = J{f+-r)dv, 

(Ic) 9tB = -VxE, V-B = 0, J ^ J V {f+ - r) dv, 

where v = v/ (w)and (v) = ^1 + Alternatively, in many physical problems 
([2], [5]), a nonneutral plasma is also considered, where there is only a single species 
of particle. 

One of the central problems in the theory of plasmas is to understand plasma 
stability and instability ([IS], [IH])- For example, to control the plasma instability in 
a fusion device is a key issue for the nuclear fusion program. Many other examples 
occur in astrophysical contexts. So far, most studies on plasma stability are based 
on macroscopic MHD models. For such fluid models, the famous energy principle 
was discovered by Bernstein, Frieman, Kruskal and Kulsrud ([1]) in the 1950s, first 
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for static equilibria and later for symmetry-preserving perturbations of symmetric 
equilibria (|26j). These energy principles allow one to reduce the study of linear 
stability to checking the positivity of a certain relatively simple quadratic energy 
form W^(CjC)- They have been widely used in the plasma physics community ([^, 
[7]) to study many types of important plasma instabilities. However, the collision- 
dominant assumption required in deriving these MHD models from kinetic models 
is seriously violated in many almost coUisionless situations in nuclear fusion ([4]) 
and space plasmas (|27:). This puts into question the applicability of such energy 
principles in physical situations where collisions are infrequent. While energy prin- 
ciples have been derived for some simple approximate models, such as coUisionless 
MHD and guiding center models ([18] [Ej [8]), there have been very few such studies 
on the more accurate but more complicated microscopic Vlasov-Maxwell models. 
A good understanding of stability for Vlasov systems could provide a theoretical 
basis to compare and check the validity of stability results for various approximate 
plasma models like MHD. Moreover, many plasma instability phenomena have an 
essentially microscopic nature, for which kinetic models like Vlasov-Maxwell are 
required (p7]). 

Combining the results of this paper with [23] , we have established an energy prin- 
ciple for a large class of symmetric equilibria of various Vlasov-Maxwell systems. 
More precisely, for a large class of equilibria that enjoy certain kinds of symme- 
try, the study of linear stability of symmetry-preserving perturbations is reduced 
to simply checking the positivity of a self-adjoint operator or equivalently the 
positivity of the quadratic form (£''^,<^). Compared with the usual MHD energy 
principle, our energy principle has several new features and advantages. In the 
MHD case, the quadratic energy form W ^) can be written as (F^, ^) where the 
force operator F has a complicated spectral structure such as gaps in its essential 
spectrum ([7]). It is difficult to analyze, especially in higher dimensions and in 
nontrivial magnetic field geometries. Our operator for RVM is essentially an 
elliptic operator plus a bounded nonlocal term and thus has a relatively simple 
spectral structure. This structure allows us to obtain important additional infor- 
mation about the linear instability. For example, we show that the maximal growth 
rate is controlled by the lowest negative eigenvalue of C'^ and that the number of 
growing modes equals the number of negative eigenvalues of 

Linear stability under the condition > was proven in ( 23J). The main result 
of the present paper is to prove the converse; that is, to construct a growing mode 
if £° ^ 0. As in we specifically consider two RVM models, the simpler l^D 
periodic case with a: S M, w G , and the full 3D case in the whole space with 
cylindrical symmetry. However, our methods are also applicable to Vlasov-Maxwell 
models with other symmetries, with boundary conditions, or in a nonrelativistic 
setting, and will yield similar results. 

Now we state our main result for the cylindrically symmetric 3D case. As re- 
marked in (|23]), the existence of a plasma equilibrium of the 3D RVM model in 
the whole space requires an external field. To simplify notation we consider a 3D 
nonneutral electron plasma with an external field. This scenario does indeed does 
occur in many physical situations {[21). So /"'" — 0, and instead of /~ we use 
the notation / for the electrons. Our equilibrium is cylindrically symmetric with 
electron distribution f'^ = fi (e,p) , where 
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(2) A0° = + + = / ^ld 



and with equihbrium fields 

E° = -dr<iPer - d,(tPe,, B" = -9;,Age^ + ^dr (Mg) e^. 
In order to be an equilibrium, (Ag, cfP^ must satisfy the elliptic system 

iv 

(3) (A - = d,,,A°, + + iS.^g -^A^,^ j veiidv. 

Here we use cylindrical coordinates (r, 0, z) and denote by (e^., eg, e^) the standard 
basis. We also assume axisymmetry of the external fields in the form 

B^-* = (r, z) + {rAf') e,. 

We assume that the equilibrium is confined, namely that has compact support 
5 in phase space. Having compact support is a realistic assumption for a confined 
plasma. We make the further assumption that /° and E°,B° are continuous ev- 
erywhere, including on the boundary of the support. In [23], with properly chosen 
external fields, an example of a continuous nonneutral plasma equilibrium with 
support in a torus was constructed. We also assume that d^/de = /ig < inside S. 
This condition is widely believed to make the equilibrium more likely to be stable 
O) [H]) [IH])- We study the stability of such an equilibrium under perturbations 
that preserve cylindrical symmetry. 

In order to state our main results, we define certain linear operators acting on 
cylindrically symmetric scalar functions h e L^(M'^) by 

(4) A^lh — —dzzh — drrh — -drh — J fi^dvh + J fi^V {h) dv, 

(5) A^h — —dzzh — drrh drh+—h — J vgfipdvrh — J ijgfi^V (veh) dv, 

(6) B'^h = J fi^V (veh) dv ~ J vgn^dv h, 
and 

(7) C" = {B'>y {A°)~' B" + Ai 

-1 

operator associated with the steady fields, namely 

£1 {) • + (E° + E'^^* + X (B° + B'^"^*)) • V„ 

and L^^ | denotes the -weighted „ space. It was proven in P31 that these 
operators are well-defined and that CP is self-adjoint. First we recall our previous 
result in [231. 



where V is the projection operator of , onto ker D. Here D denotes the transport 
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Theorem 1.1 ( 23J). Consider a nonnegative axisymmetric equilibrium (^f*^, E*^, B'') 
as above with compact support S in phase space. Assume fi^ < inside S . For ax- 
isymmetric perturbations, we have following results. 

(i) C'^ > implies spectral stability. That is, if > then there does not exist 
a growing mode. 

(a) Any growing mode must be purely growing. That is, if 

[e^*/(x, v), e^*E(a;), e^*B(a;)] {ReX > 0) 

with E, B g L^, f G f] L°° is a solution of the linearized system, then A is real. 
(Hi) If C'^ ^0 and —oP' denotes the lowest negative eigenvalue of the operator 
, then the maximal growth rate A cannot exceed a. 

Theorem 11.11 asserts the hnear stabihty if > and it also estimates the 
maximal growth rate if £° ^ 0. However, it leaves open the converse, namely the 
question of the existence of a growing mode when L''^ ^ 0. In this paper, we fill this 
gap by showing that there indeed always exists a growing mode if /Z*^ ^ 0. This is 
the main result of the present paper. 

Theorem 1.2. Under the same assumptions as in Theorem \l.l\ 

(i) if ^ 0, there exists a growing mode; that is, an exponentially growing weak 
solution 

[e^^fix, w), e^*E(x), e^*B(a;)] (A > 0) 

of the linearized problem with f £ C\ L°° and E, B G . 

(ii) The dimension of the space of symmetry-preserving growing modes equals 
the dimension of the negative eigenspace of £° . 

The combination of Theorems 11.11 and II. 2|, establishes an "energy principle" 
for this class of equilibria, in terms of the relatively simple operator Thus 
this operator C'^ not only provides the sharp stability criterion, but also contains 
information about the number of unstable modes and their maximal growth rate. 
The projection V that occurs in the definition of £° is a highly nonlocal operator 
since Vh {x, v) turns out to be essentially the average of h in the phase space 
occupied by the particle trajectory with the steady field (E° + E"^^*, B° + B'^^*) 
starting at {x,v). So our sharp stability criterion /I*^ > is also highly non-local, 
which reflects the collective nature of plasma stability. Because of the condition 

< 0, it turns out that all the nonlocal terms are stabilizing. 

In ,10J, Y. Guo investigated the stability of a two-species plasma satisfying 3D 
RVM without external fields, in a bounded domain with the perfectly conducting 
boundary condition. In a similar setting to ours, a sufficient condition for stability 
was obtained in [lOj by the energy-Casimir method. Extending the calculations in 
[To] to the whole space case, we would obtain the stability condition that L° > 0, 
where is the differential operator 

(8) L° = -dzz - drr - ^dr + ^ - r J vetipdv, 

the last two terms being multiplication operators. However, since £° > L*^, the 
stability criterion > in our Theorem 11.11 is a significant improvement because 
of the additional stabilizing effects that come from the non-local terms in . More 
importantly, in the l^D case discussed below, we showed in that these nonlocal 
stabilizing terms are indispensable to prove the stability of any equilibrium, even 
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a homogeneous one. We believe that the non-local stabilizing terms must play an 
important role in plasma stability in the 3D case as well. 

The simplest case that permits a magnetic field is the so-called 1^ dimensional 
case. In this case, physical space is one-dimensional a; g R and momentum space 
is two-dimensional v = (wi,W2) G R^- Moreover, E = (£'i,i?2,0) and B — (0,0,-6). 
We consider solutions that are periodic in x and we may assume that there is no 
external field. In Section 2, before going on to the proofs of Theorems 11.11 and 11.21 
in 3D, we prove precise analogues of these theorems for this much simpler case. 
Various particular stable and unstable l^D examples were constructed in [23 . In 
[24j we also proved the validity of these linear stability and instability results on 
the nonlinear dynamical level. 

We now sketch the main ideas in the proofs of Theorems 11.21 and its 1 1 di- 
mensional analogue, which are concerned with the construction of growing modes 
provided that ^ 0. We begin with some brief historical comments on linear 
instability for Vlasov systems. One of the main difficulties in studying Vlasov in- 
stability is its collective and thus highly nonlocal nature. In the physics literature, 
most classical studies (|25j. |29j ) treat homogeneous equilibria with vanishing elec- 
tric and magnetic fields, in which case an explicit algebraic dispersion relation is 
usually available. However, any nontrivial electromagnetic field will make the dis- 
persion relations much more difficult to analyze because they depend upon some 
complicated trajectory integrals. In [12] and later publications [13], [14], [15], Guo 
and Strauss developed a perturbation approach to prove the instability of weakly 
inhomogeneous equilibria of Vlasov-Poisson systems. They proved the instability of 
various electrostatic structures that are close to an unstable homogeneous equilib- 
rium. In [21 Lin developed a new non-perturbative approach to find purely growing 
modes for highly inhomogeneous equilibria of ID Vlasov-Poisson. This approach 
has recently been used ([TT]) as well for galaxy models satisfying 3D Vlasov-Poisson. 
There are two elements in this approach. One is to formulate a family of dispersion 
operators Ax for the electric potential, depending on a positive parameter A. The 
other is to prove the existence of a purely growing mode by finding a parameter 
Ao such that the A\g has a kernel. The key observation is that these dispersion 
operators are self-adjoint due to the reversibility of the particle trajectories. A con- 
tinuation argument is applied to find the parameter Ao corresponding to a growing 
mode, by comparing the spectra of A\ for very small and large values of A. 

Let us explain the difficulties in extending this approach to the electromagnetic 
case. We first recall the method in in the periodic l^D case. Assuming that 
the growing mode has periodic electromagnetic potentials {(f>, ip) such that Ei = 
—dx<t>i B — dxip, E2 — —dtip, we express / in term of them by integrating along the 
trajectories. Plugging / into the Maxwell system and using the condition /i^ < to 
eliminate 0, we get a self-adjoint dispersion operator for ^ alone. Then we apply 
the continuation argument as in 21j. The difficulty with this approach is that the 
equation 

(9) dtEi = -ji 

(the first current equation of Maxwell) does not follow from the dispersion operator. 
Under additional evenness assumptions in the variable x, we proved in [23| by means 
of a parity argument that ji has zero mean. Then ^ does follow from the Poisson 
equation 

dxEi = p 
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and we get a growing mode. 

In order to make this construction without any evenness assumption, we need 
a new formulation. To do this, we express Ei = —dx4> — Xb where the scalar b is 
introduced to account for the possible nonzero spatial average of Ei and A is the 
exponential growth rate. Once again we express / in terms of (0, tp, b) by integration 
over the trajectories and plug it into the Maxwell system. The equation ([9|) can 
now be handled by means of this additional number b. Again we eliminate using 
the the condition /i^ < and the resulting equations for and b can be written in 
a self-adjoint matrix operator form. We then apply the continuation argument to 
this new dispersion matrix by keeping track of its negative spectrum. 

The proof of Theorem 11.21 in the 3D case is much more subtle. We start with 
the electric potential (p and the magnetic potential A — {Ar, Ag,Az). Of course we 
define E = — V0 — dtA and B = V x A. Our strategy is to represent / in terms 
of {(/), A) and plug it into the Maxwell system to get a self-adjoint formulation for 
the electromagnetic potentials. To achieve this goal as well as to satisfy the current 
equation, our key observation is to impose the Coulomb gauge condition V • A = 
and use the cylindrical symmetry to define a "super-potential" tt (r, z) such that 
V X (Tree) = {Ar,0, Az). We then express / in terms of {(j>,Ae,Tr) by integrating 
along the trajectories of the equilibrium and the external field and then plugging 
it into the Maxwell system to derive a system of equations for the three unknowns 
(j),Ag and tt. The introduction of this "super-potential" tt allows us to separate 
the 9 and {r,z) components of the current equation (j40|) . The resulting system 
for {(p,Ag,7T) indeed turns out to be self-adjoint. We then eliminate cj) using the 
the condition /ig < to get a 2 x 2 self-adjoint matrix operator Ji4^ for {Ag,n), 
depending on a positive parameter A. 

However, this matrix operator is bounded neither from below nor from above so 
the continuation argument cannot be applied directly. To handle this new difficulty, 
we perform an n-dimensional truncation in the function space for tt. The truncated 
matrix operator Ai^ has entries that are high-order integro-differential operators. 
It is bounded from below (by a bound depending on n), which allows us to apply 
the continuation argument to get an approximate growing mode. We then let n 
go to infinity. The limit of this approximate growing mode is shown to satisfy the 
original linearized Vlasov-Maxwell system weakly. 

However, it is still very subtle to show that this limit indeed gives us a true 
growing mode. There are two issues to clarify. The first is to show that the limit 
does not vanish, for which we need a uniform bound of the approximate growing 
modes. The second issue is to show that the growth rate does not tend to zero as n 
go to infinity. For this, we need to get uniform control of the spectrum of Al,^ for 
small A and large n. This turns out to be quite delicate since the operators involved 
merely converge to their limits weakly as A \ 0. In our proof the compactness of 
the support of the confined plasma equilibria plays a crucial role, allowing us to get 
some compactness of the operators. 

As for Theorem 11.21 (ii), the lower bound on the number of growing modes 
is a corollary of the continuation argument. To get the upper bound, the key 
observation is that any two growing modes are orthogonal in some sense due to a 
certain invariance property proven in |23| . We note that such counting formulae 
are unknown for the standard energy principles ([1], |19j ) for approximate plasma 
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models like MHD. In our case the simple spectral structure of the operator £° is 
essential. 

The new formulation and techniques developed in this paper can also be used to 
detect linear instability of general Vlasov-Maxwell equilibria without the monotone 
assumption /ig < 0. The idea is to formulate the growing mode problem as a 3 x 3 
indefinite matrix dispersion operator including (j) and then to use the truncation 
and continuation arguments to study it. In this way we find a sufficient instability 
criterion by utilizing the difference of the signatures of the matrix operators at small 
and large parameters. We illustrate this idea in Section 9 by getting a instability 
criterion in l^D purely magnetic case that generalizes the sharp criterion in the 
monotone case. 

The methods of this paper and of '23j can also be used for nonrelativistic Vlasov- 
Maxwell systems and also for other symmetries, for example, the 2^0 Vlasov- 
Maxwell system with its z-symmetry [6,. For such cases, but still assuming that 
the distribution function depends monotonically on the particle energy, we can 
establish similar energy principles in terms of a certain self-adjoint operator C'^. 
For the nonrelativistic case the operator is formally obtained from its relativistic 
version by dropping the hat in v. Since the results and the proofs are similar to 
the cases we treat here, we do not elaborate any further. 

The paper is organized as follows. In Section 2, we treat the easier l^D case. 
The proof for the 3D case is split into six sections. In Section 3, we formulate the 
problem using (</), Ag, tt) and derive the dispersion matrix operator for {Ag, tt). 
In Section 4, we present the key mapping and spectral properties of the operators 
appearing in the formulation. In Section 5, we study their behavior for small A and 
introduce the finite-dimensional truncation. In Section 6, we find the approximate 
growing mode for each n. In Section 7, we take the limit of the approximate growing 
modes. In Section 8, we check that this limit is indeed a true growing mode. In 
Section 9, we extend our formulation to equilibria that are not monotone in the 
energy e. 

2. fi DIMENSIONAL CASE 

In this case, physical space is one-dimensional a; G M and momentum space is 
two-dimensional v = {vi,V2) £ M^. Moreover, E = (£'i,i?2,0) and B ~ {0,0, B). 
Assuming no external field and setting all physical constants to be 1, system ([!]) 
reduces to the following l^D RVM system 

(10a) dtf^ + vid.f^ ± (-El + v2B)d,J^ ± {E2 - viB)d^J^ = 

(10b) dtEi = -ji, dtE2 + d^B = -32 

(10c) dtB = ~d,E2, d,Ei = p 

with 

P = I (./+ - Ddv, J, = J €,(/+ - r)dv {t = 1,2). 

The main reason to consider l^D RVM is its simplicity and yet it preserves many of 
the essential features of 3D RVM. We refer to [23 for astrophysical applications of 
this model and to [5] for a proof of global well-posedness. We will consider solutions 
of the system ([TU)) that are periodic in the variable x with a given period P. 
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First we take a P-periodic equilibrium 

(11) = M^(e±,p±) = M*((«> ± 0"(^),«2 ± V'°W), 

where the pair (0",^'^) satisfies the ODE system 

(12) dl<j^'^-p' = -J{f^+-f'-)dv, dl^' = -f,=-jv2{f'+-f-)dv. 
We assume that 

(13) A^±>0, Me^O, |^±| + |;,±| <c(l + |e|)-" 

for some a > 2. In ^23j we proved that there exist infinitely many periodic electro- 
magnetic equilibria of the above form. Now we denote 

= vA ± {El + i)2S")a.i T , 



|/ / periodic in a; , \\f\\\ = J \f\^\fj.f\dvdx<oo^ , 



and = the projection operator of ^^^±^ onto ker_D^. We define the following 
linear operators acting on Lp(R), where the subscript P refers to the periodicity. 



(14) 



(15) A'^^h = -ly h^^Uv ]h-y fifh V^{v2h)dv. 



± / ± 



(16) 



and 

(17) £" = (S")*(y^?)-iS" + yi^. 

Similarly to the 3D case, we proved in |23| the following theorem. 

Theorem 2.1. Consider periodic perturbations of any equilibrium satisfying the 
conditions given above. Then 

(i) > implies spectral stability. 

(a) Any growing mode must be purely growing. 

(Hi) If —a^ denotes the lowest eigenvalue of the operator C'^ , then the maximal 
growth rate cannot exceed a. 

Moreover, it was shown in |23| that if tjP,(l)^ are even functions of x around 
X = P/2 and if/}" has an even eigenfunction corresponding to a negative eigenvalue, 
then there exists a growing mode. In the following theorem proven in this section, 
we assert that ^ always implies the existence of a growing mode, without any 
additional evenness assumptions. 
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Theorem 2.2. Under the same assumptions, 

(i) If ^ 0, then there exists a real periodic growing mode [e^'^f{x,v),e'^'^E{x), 
e^*B{x)] with f,E,B e Wp'^ and A > 0. 

(ii) The dimension of the space of growing modes equals the dimension of the 
negative eigenspace of £° . 



The combination of Theorems 12.11 and 12.21 provides an energy principle for the 
l^D case, in terms of the operator 

With the sole purpose of simplifying our notation, we present the proof in the 
case of a constant ion background uq. (For the more general two-species case, the 
proofs remain almost the same except for the more cumbersome notation.) Then 
the l^D RVM for one species becomes 

(18a) dtf + vAf - (Si + V2B) d,J- {E2 - viB) d^J^O 



(18b) dtEi = -n = J vif dv, dtB = ~d.,E: 

(18c) dtE2 + d,B = -j2 = J V2f dv 

with the constraint 

(19) d^E^ = no - I f dv. 



2 



Fixing any such equilibrium with a period P, we will consider the system (21) with 
periodic boundary conditions of the same period P. 

The equilibrium is assumed to have the form /° — fi{e,p), E^ ~ -~dx<t>^,E2 = 
0, = dx^^, where the electromagnetic potentials (^cj)^, -0°) satisfy the ODE system 

,2-0 _ „ / ,,/ \i„. q2 -,o 



d^(j) ^no-J fi{e,p)dv, d^tp = J V2pie,p)dv 

with the electron energy and the "angular momentum" defined by 

(20) e^ {v) ~<l>°{x), p^V2-^"{x). 

(The e is distinguished from the exponential e in context.) The only assumptions 
we make on fi are 

(21) /i>0, fieC\ p, = ^<0 

and, in order for J (|/ig| + \Pp\) dv to be finite, 

(22) + \pp\) {e,p) < c(l + |e|)"" for some a > 2. 
Hence the linearized evolution equations are 

(23) {dt + D)f = p^viEi - fipViB + {p^V2 + ^ip)E2, 
where D is the transport operator associated with the steady fields, 

D = vidx - {E'l + V2B°) dy, + viB'^dy, 

together with 

(24) dxEi ^- J fdv, dtEi = Jvifdv, dtE2+dxB - J hfdv, dtB+dxE2 = 0. 
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We define the Hilbert space 



f periodic in x, H/Hf^,^, = J J^^ \ff\fijdvdx < oo 



and denote its inner product by (•, •)|^ |. Let V be the projection operator of L^^ 

onto the kernel of D. We also denote by Lp {^p) the space of P-periodic {^x) 
functions for p > 1. 

Similarly to the two-species case, we define the following four operators, each of 



which acts from Hp to Lp, 



A'ih = -d'^h - (^J n^dv^ h + J fi^Vh dv, 
Ah = -dlh - (^j hf^pdv^ h- J fi^V2V{v2h) dv. 



B°h 



,,dv)h + J,^nv2h) dv 



and 



In these definitions one should keep in mind that /i > is a function of a; and v, that 
/ig = dfi/de < and that /ip = dfi/dp. It was shown in [23] that Al is invertible 
on the range of K° so that £° is well-defined. The following is the analogue of 
Theorem [ 



Theorem 2.3. Assume i21\) and 

(i) If ^ 0, then there exists a real growing mode [e'^^ f{x,v),e^^E{x),e^^B{x)] 
with f,E,B £ lyi'i and A > 0. 

(a) The dimension of the space of growing modes equals the dimension of the neg- 
ative eigenspace of L'^ . 

For the proof of this theorem we introduce the particle paths {X{t; x, v), V{t\ x, v)), 
which are the characteristics of D. They are defined as the solutions of 

(25) X^Vu Vi^d^^'\X)-V2dx^\X), V2 ^ VA^^^ (X) 

with the initial conditions X{0) — x, V{0) — v. Using the particle paths, the next 
three operators depending on a parameter A > were already introduced in |23j 

A^h = -dlh - (^j fi^dv^ h + J /ig J Xe^''h{X{s))dsdv, 
A^h = -dlh + \^h - (^j V2Pipdv^ h- j ht^, J Xe^''V2{s)h(X{s))dsdv, 

B^h= (^j fij^dv^ h + J fi^J Xe^'V2{s)h{X{s))dsdv. 

The following lemma in 23J shows that Ai is invertible on the range of B^, so that 
the operator 

= {B^)*iA^)-^B^ + Ai 

is also well-defined. 
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Lemma 2.4 ([23). Assume A > 0. 

(i) The operators Aj, (j = 1, 2) are self-adjoint on Lp with the common domain 
Hp. Their spectra are discrete. 

(ii) > 0. 

(Hi) The null-space N{Ai) consists of the constant functions. The inverse {Ai)~^ 
IS bounded from {h e L% \ hdx = 0} = N{A^)^ D R{B^) into Hj,. 



We also introduce the following three functions that depend on A > 0. 
b^{x)= / A*e / Xe^''Vi{s)dsdv, 



c^{x) = / hfJ-e I Xe^''Vi{s)dsdv, 
d^ = {B^)*{A^)-^b^ -c^ 

and three constants 

= [ [ vifJ-e [ Xe^'Vi{s)dsdvdx, 

^ Jo J J-oo 

^ 1 {{A^^)-H\b^) , k^ = P{X^-l^- m^) . 

Define to be the operator from R to L|, by (6) = bd^. Its adjoint {T^)* 
mapping Lp to M is defined by J^^ (ifi) — (Tp,d^). We define the matrix operator 
from HlxRto L%xRhy 

^ [b )-[ -bk^-v{i,,d^) )- \ {T^y -k^ )[ b 

By Lemma it is obvious that A^'^ is self-adjoint and has only discrete spectrum. 
The following lemma explains the purpose of Al^. 

Lemma 2.5. If Ai^ has a non-trivial nullspace of even functions for some A > 0, 
then there exists a purely growing mode in W^'^ of 



To clarify the ideas, below we present our original derivation of the matrix op- 
erator M.^ from the equations satisfied by a growing mode. The proof of Lemma 
12.51 is almost the reverse process of this derivation, as in the proof of Lemma 2.5 of 
[23] . So we skip it here. 

To derive Al^, we start with a growing mode [e^* f{x, v), e^^E{x), e'^*-B(x)]. Since 
it was shown in [23j that a growing mode must be purely growing, we can assume 
A > 0. Define the electromagnetic potentials 0, ■0 and an number 6 € R such that 

B = d^ij;, E2 = -A-0, El = -9^0 - Xb. 

Then [f{x, v), 4>, ijj, b] must satisfy 

(26) Xf + Df = -^jL^vidxcj) - Xbfx^vi - ^ipVid^ip - iXfi^V2 + Xfj,p)ip 
and 

(27) d^Ei=p, XEi^-ji, XE2 + d^B^~j2, XB d^E2 ^ 
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with p = — J fdv and ji — — J Vifdv. Integrating (|26|) along the particle trajectory, 

after an integration by parts we have 

(28) 

ds. 



f{x,v) = - t^p^{x)+fi, / Ae^^ 0(X(s)) - V2{.s)i;{X{s)) - bV,{s) 

The first and third equations of ([27|) are equivalent to ~d^(j) — p and (— <9^ + A^) -tp — 
j2- After plugging P5|) into them, they become 

(29) Ai(f) = B^il; + bb^ 
and 

(30) A^^|^ = -{B^y(f> + bc^. 

The last equation in (|27p is automatic. 

The second equation in (j27p is AE'i = ~Ji, from which we will now derive 
an equation for b. By the continuity equation dxji + Ap = 0, we have — 

—p= jdxji, which implies that dx(t> = j (ji — -p jidxj. Thus \Ei = —ji is 
equivalent to X^b = -p jidx. Plugging ((28)l into this result, we obtain 

X'^b^^J J^if^eJ Xe^' \^-(l>{X{s)) + bVi{s) + V2{s)ij{X{s))^dsdvdx 

^1 + 11 + III. 
The first term is 

/ = -! " 
p 



Ae / / p,^(j){x)Vi{-s)dvdxds 



^ I Xe^' I f pj {x) Vi is)dvdxds = ^ (0, b^) , 



where for the first equality we changed variables (a;, v) \^X{—s),V{—s)j and for 
the second equality we changed variable v —v and used the trajectory property 

{X{-s;x, ~vi,V2), -V\ {~s:x, -Wi, W2) , "1^2 {-s:x, -Wi, W2)) 

= {X{s\X,Vx,V2),Vy {s\X,Vx,V2) , V2 [s;X,Vx,V2)) . 

Similarly, /// = — (■0,c'^). By definition, // — bl^. Thus the equation for b is 

(31) ^x'-l')b=^[{ct>M)-{i',c')]. 
By (Uni) we get 

(j)={Ai)-^B^i^ + b{A^y^b^. 

Plugging this into (l30|) and ([3T|) . we have the pair of equations C^ip + bd^ ~ and 
-bk^ + {ip, d^) = by definition of d^,k^ and C^. That is, the pair {ip, b) belongs 
to the kernel of the matrix operator A^^. We note that in the above formulation 
the equation XEi = —ji is exactly taken care by the extra constant b. 

Similar to the proof of Lemma 2.5 of [23], we can show that a nontrivial kernel 
of A^'*' indeed gives a growing mode. Moreover, we also showed in [24] that for any 
growing mode, / € W^'^ and the linear instability implies nonlinear instability in 
the macroscopic sense. 
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b r\ b 



l,Ai,2 



Lemma 2.6. ^ 0, then there exists A > such that M''^ has a non-trivial 

nullspace. 

Proof. Let n'*' be the dimension of the eigenspace of Al'^ corresponding to its neg- 
ative eigenvalues. We first claim that for sufficiently large A, n'*' < 1. Indeed, it is 
shown in 23J that > A^ — Cq for some constant Co independent of A. It is also 
easy to show that ||rf''*||^2 ^ C'l for some constant Ci independent of A, as in the 
proof of Lemma 2.4 of [23]. So 

)^ = {C^^,^j)+2b {^,d^)-k' 

> (A^- Co) ||^||^-2Ci|6| 11^112 -|fc^|62 

> - {C^ + \k^\)b^, 

provided A^ > Cq + I. Since 6 e M, it follows that Ai^ has at most a one-dimensional 
negative subspace. We now show that if A is small enough, then > 2. It is shown 
in [23] that £^ £° strongly when A ^ and 

lim / \e^''h{X{s),V{s))ds = rh 

in the norm of L? , for all h (1 L? ,. As in the proof of Lemma 3.3 of [23], the 
projection operator V maps a function that is odd or even in vi to another function 
with the same symmetry property. So as A ^ 0, 5^ ^ / ii^V{vi)dv = and 
similarly c'*' ^ in Lp strongly. Thus d'*' — > and — > in Lp strongly as 
A — > 0. So we have 

strongly in Lp x M as A ^ for all ip e i/p and 6 G M. Here 

/ lA^el {V{vi) fdvdx > 0. 
J 

Since £° has at least one negative eigenvalue by assumption, has at least two 
negative eigenvalues. Thus by ([E], IV-3.5), n"^ > 2 if A is small enough. 

For A > 0, it was shown in [53] that is continuous in the operator norm. So 
is also continuous in the operator norm for A > 0. Thus if has no kernel 
for all A > 0, then remains a constant which is inconsistent with the behavior 
of near zero and infinity. So we conclude that for some A > 0, Al^ must have a 
nontrivial kernel. This completes the proof of the Lemma. □ 

Theorem [23] (i) on the existence of growing modes follows immediately by com- 
bining Lemma 12.51 and Lemma l2.6l 

For the proof of Theorem l2.3r zz). we need the following two lemmas. We consider 
real functions below, as all growing modes should be by Theorem l2.1l The following 
functionals were defined in [23] . 

(32) J(/,i?i,^) = J J ^^{f + ^,^^fdvdx + J [E.fdx 

(33) I{f,Ei,iP)^J{f,Ei,iP)- [[ V2t^„^^dvdx+ f [{dtijf + {d^^f]dx 



14 



ZHIWU LIN AND WALTER A. STRAUSS 



and we denote 



I Me 

The next lemma follows immediately by polarization from Lemma 2.7 of j23j . 

Lemma 2.7. Consider two real solutions (/* (t) , E^ (t) , (t) = dxi''' (t)) ,i — 1,2 
to the linearized system (Q^j, with initial data (/* (0) , E^ (0) , (0) — -0^, (0)) G 
m t/ie constraint set 



C = ^JJ f{0)dvdx = 0, d^EiiO) ^ - J f {0)dv and J B{0)dx^Oj, 

satisfying J(/(0), -Bi(O), ijj (0)) < oo. Then the functional 
I{f\El^';f^,Eli;'){t) 

= Jif\EliP';f^,El^^) - J J wsMpV' V'd^^rfa; + J[dt^P'dt^^ + d,^^d,^^]dx 
is independent oft. Furthermore, for all g € kerZ?, the functionals 

(34) Kg(f\i,') =JJ [f + («2/ie + 9 dvdx 
are also independent oft. 

Proof of Theorem \2.3\ (ii). Assume the linearized system (f23| . (f24| has I indepen- 
dent growing modes and the operator L'^ has a fc— dimensional negative eigenspace. 
By the proof of Lemma l^TBl as A increases from to +00, the negative eigenvalues of 
must cross the imaginary axis at least n {M.^) — 1 times, with n (Al") = k + 1 
being the number of negative eigenvalues of M'^ . Since we get a growing mode at 
each such crossing, there exist at least k growing modes. Thus I > k. 

It remains to show that I < k. Suppose otherwise, I > k. Let j^^, • • • , C ip 
span the negative eigenspace of Denote the I linearly independent growing 
modes by e^'^*[f^{x,v), El{x),ip^{x)],i — 1, • • • ,1, where ip^{x) is the magnetic po- 
tential dxip^ = -B'. By Theorem 12. II (ii). Ai are real and positive and we only need 
to consider real functions below. 

First we will prove that {i{}^{x)}^_^ are linearly independent. Indeed sup- 
pose (ci,--- ,q) £ M' such that ^p"^ (x) — J2\^i Ciifj^ (x) — 0. We denote — 
X]'=i "^i/* ^'^d Ef — Y^l^i CiE\. Applying Lemma [2.71 to any two growing modes 
e^^*'[f''{x,v),E{(x),%l)\x)] and e^^^lf^ {x,v),E{(x),%1)^ {x)] with 1 < i,j < I, we have 

= Iif\El4,'-J^,Ei,^^) 

= J{f\E\,i,'- f^,Elij^) ~ jj hfipi^'i^'dvdx + j [A.A.VV-'' + i'li^Udx. 

In particular, 

(35) = J {r, E{, - 11 hfir, dvdx 



2 

+ / irj" dx+ I \,c,i>' I dx. 
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But V'' = SO that 

(36) = Jir,E'^,0) + J (^^X,c,ib'^ dx 

Thus we have f = 0, = and therefore X;Li c^[^{x, v), El{x), ^p'{x)] = 0. It 
follows that ci — ■ ■ ■ ^ Cn ~ by the hnear independence of [p{x, v), El{x), %p\x)]l^i. 
This proves our claim that {ip^ {x)} is linearly independent. 

If ^ > fc , there exists a linear combination ip'^ [x) = X]i=i diil>^{x) with a nonzero 
vector (di, • • • , c?i) G R', such that ijj'^ _L for any 1 < j <k. Using the equation 
((55)) for we have 



(37) 



= J 



r 



dvdx 



+ 



dx 



Vi=l / 

Now by Lemma 12. 7[ for all g E ker D each functional 

i^<,(/\^^) = [/' + ihf^, + A*p)Vl 9 dvdx 
vanishes, so that Kg{f'^, ■0'^) = 0. Thus by Lemma 2.8 of [13], we have 



> 



j[f,E'},^'') 
and ([57]) implies that 

o> ((S")*(y^?)-is>'',v'') 



V{v2^f) |/.Jdi;dx + ((S")*(^°)-isV,V''') 



+ 



r 



dvdx 



id 



dx 



+ / ^ Kdti// dx 



y"|^^A,d,V"^ dx 



= (^V'^') + 1 (J2\^d^^'^ dx. 

Since V'*) > 0, we deduce that J^Li = 0. So {V'*(a;)}[^i is linearly 

dependent, which is a contradiction. Therefore I — k. This completes the proof of 
Theorem [Zl □ 



3. Formulation of the 3D problem 
The 3D RVM for a non-neutral electron plasma with external fields is 
dtf + v- V,/ - (E + + vx{B + B'^"*)) • V„/ = 



16 ZHIWU LIN AND WALTER A. STRAUSS 



StE - V X B = J vf dv^ - 

5tB + V X E = 
y ■ E = - I f dv = p, V-B 



where a; G M"^, w G M'^. Wc consider solutions of finite energy. Thus they vanish in 
some averaged sense as \x\ — > oo. 

We use the same notation as in The cyhndrical coordinates in R'^ are (r, 9, z) 
and the standard cyhndrical basis is e,., e^, e^. The equilibrium distribution function 
is assumed to have the form f'^ ~ fi (e,p) , with 



p^r{vo~A"g {r,z)^Ar (r, z)) 
and the equilibrium fields are assumed to have the form 

EO = -a,0°e, - d,cf>°e,, B" = -^.A^e, + (rA°) e„ 

with satisfying the elliptic system We assume /° has compact 

support S in {x,v) space and f^,E^^B'^ are everywhere C^. Such equilibria were 
constructed in the appendix of [53] for certain 0*^^*, Ag^^ and /i. We assume that 

/ig < on the set {/i > 0}. 

For the perturbations E, B of the electromagnetic fields, we introduce scalar and 
vector potentials (j) and A such that 

E = -V0 - dtA. and B = V x A 

and we impose the Coulomb gauge V • A = 0. We will consider only axisymmetric 
perturbations. In cylindrical coordinates we write A = Are,. + Ageg + A^e^. We 
assume that Ar, Ag, A^ and independent of 9. Some differentiation rules in 
cylindrical coordinates are collected in the appendix. Then the corresponding fields 
are given by 

E = {Er,Eg, E,) = {-dr(t> ~ OtAr, ~dtAg, -9,0 - dtA,) , 

B = {Br,Bg,B,) = {-d,Ae, d,Ar - drA,, (rAe)) . 
Then the linearized Vlasov equation becomes 

(38) dtf + Df^ -f^eD^ - Aie« • dtA - rp^dtAe - [rAe) , 
where 

£1 = f) • - (E° + E^^* + X (B° + B'^^*)) • V„ 
(see the appendix). The Maxwell equations become the scalar equation 

(39) A0 = -p = - y" fdv 
together with the vector equation 

(40) + - AA = j = - I vfdv 



STABILITY CRITERION FOR VLASOV-MAXWELL 



17 



We are looking for a axisymmetric growing mode [e'*'*/(a;, v), e'^*E(a;), e'*'*B(x)] , 
which means we replace dt by A everywhere. Here ReA > and (E, B) is indepen- 
dent of 6. By Theorem 11.11 of A must be real and so A > 0. Because of the 
Coulomb gauge condition, we have 



r dr dz ' 

so that we can introduce a super-potential tt (r, z) such that 

Ar = —dzTT Az — —dr (rTT) = dj-TT H TT. 

r r 

Replacing dt by A and substituting -0 • A = vgAg — Vr{—dzTr) + Vz{drTT + ^tt), we 
rewrite the Vlasov equation ([55)1 as 

(41) {X + D)f = -pL,D(t> ~{X + D) (rfipAg) - n.XvgAg 

- A*e-^ [-Vrdz + Vz {dr + 7)] TT. 

We can explicitly invert the operator (A + D) by introducing the particle paths 
{X{t; X, v), V{t; x, v)), which are the characteristics of D. They are defined as the 
solutions of the ODE 

(42) X ^V, y = - (E" + E'^^*) {X)-V X (B° + B*="=*) (X) 

with the initial conditions X{0) — x, V{0) — v. Integrating (|41]l along the path 
from t = —00 to i = 0, we get 



(43) / {x, v) = -fi^cj) + fi^ / Xe^'cj) (X(s)) ds - pij^rAg 

J —00 

Xe^'Ve{s)Ag {X{s))ds 



Me / Ae^^ {-V; [S) dz^ {X{s)) + Vz [s) {dr + i) TT {X (s))} 



ds. 

Now it is convenient to introduce the following operators depending on a positive 
parameter A. These operators will be used throughout the rest of the paper. For 
k = k (x, v) define 

{Q^k){x,v)^ / Xe^''k{X{s;x,v),V(s;x,v))ds 

and 

Gk = —Vrdzk + Vz {dr + fc , G*k = Vrdzk — Vzdrk. 
For h = h{r,z), define all of the following operators. 

Aih = -Ah- (^J fi^dv^ h + Jfi^Q^hdv 

A^h = (-A + ^ + X^^h-r(^j vgUpdv^ h- j vgfi^Q^ (vgh) dv 
B^h^-i vgfijv ]h+ fi^Q^ (vgh) dv 



£^ ^ {B^Y {A^y B^ + A^ 
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C^h = / ve^ieQ^ {Gh) dv, (C^) G* {^i,Q^ (veh)) dv 



J f^eQ^ (Gh) dv, {V^y h = - Jg* {fi^Q^ (h)) dv 
£^h^ J G* (m,Q^ (Gh)) 

- (-A + J^) (-A + + A^) - £^ 
A' = A' - {-^'Y i^iV' = (-A + (-A + + A^) - 

Here these operators are defined formally. In the next section, they will be defined 
carefully and key properties will be derived. 

Using these operators, we can rewrite the formula as 

(44) / = -Aie0 + MeSV - ^^prAe - MeQ^ (veAe) - ^i,Q^ (Gtt) . 

Moreover, substituting (|44ll into the Poisson equation — A(/) = / fdv, we obtain 



-A(j) = -[^J ^^edvj(t) + J li^Q (t'dv - fipdvj rAe 

- J MeQ^ i^eAe) dv ~ J /i,Q^ {Gtt) dv. 

Since r J iipdv — — J vgfx^dv, this result can be written as 

(45) A^<l> = B^Ag + V^TT. 

With dt replaced by A, the Maxwell equation ((40|) becomes 

(46) A^A + AV0- AA^j. 
Taking the 0— component of (|46l) and substituting (|4T|) . 

(A'- A) Ag = - Jvgfdv 

Vgfi^dv^ (j) - J Vgfl^Q^<j)dv + Vgflpdv^ rAg 

velJ-eQ^{veAg)dv+ / vgfi^Q^ {Gtt) dv. 



That is, 

(47) A^Ae = ^{B^y4> + C\. 
Lemma 3.1. 

(48) A^TT^{V^y<j>-{C^yAg. 
Proof. First we claim that 

(49) (-A +^){^A+^ + X") TT = d,3r ~ drjz. 

Indeed, let K = jr^r + jz^z and I = (—A) ^ K so that e^ • I = 0. By the continuity 
equation dtp + V • j = 0, for a growing mode we have 

V • K = (9, + i) jr + d,j, = V • j = -Ap = XAcj). 
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Thus the vector identity 



V X (V X K) 



AK + V (V • K) 



takes the form 



V X (V X AI) 



AK + AVA(/) 



or 



V X (V X I) = A' - AV^. 
Now the r and z components of the Maxwell equation can be written as 
(A^ - A) {ArGr + A,e^) = K - Wcj). 

Furthermore, 

ArSr + A^e^, = -{dzn)er - {{dr + i) tt) = V X (Tree) • 
Combining the last three equations, we have 



which is satisfied if 

(A' - A) (Tree) = V x I = {dJr - drh) eg. 
Noting that Aeg = —73- eg, we deduce 

Applying — A + to this result yields 

(-A + -^) (-A + 4, + A^) 7T = d, (-A +^)lr~ dr (-A) h 

= dzjr ~ drjz 

since [dr,—A] = -^dr- This proves the claim. 

Upon substituting (I44|) into jr = J Vrfdv, the first and third terms vanish 
because they are odd in The same reasoning is valid for = Jv^fdv. Therefore 



In IMl) caU the first two terms T (0). Then 

(?'(</') ,V')l2(r3) = 2Tr JJ T{(j))iprdrdz 



V X (A^ - A) iireg) 



V X (V X I) , 



(50) 




The last four terms in (jSO]) equal 




20 



ZHIWU LIN AND WALTER A. STRAUSS 



L2(K3) 



by Lemma 4.1(rf) below since (jj is independent of v. The last expression equals 

So T (0) = (P^)* 0. Thus by (gg) and ([501), 
Hence 

□ 

We now have three equations ([45l) . (|47| and (|48|) that link the unknowns 
and TT. Using (I45|) to eliminate 0, we obtain 

y^^TT = (P^)* (y^t)"' [SMe - Ag. 

That is 

(51) = 
and 

(52) AIt: = T^Ae. 

These are the basic reduced equations of which we want to find a non-zero solution. 
Motivated by ([STj) and ([52]) . we define the matrix operator 

(53) M^Y% (f^r) 

of which we want to find a non-trivial nuUspace. 

4. The Operators 

Let the space L| consist of the cylindrically symmetric functions (functions of r 
and z only) in I? {MF) . For any positive integer k, let 



and llV'll/ffct = ||e*^^/'||^fcj-jj3^- Furthermore, we define V''^ to be the closure of the 
cylindrically symmetric functions in C^(IR."^) with respect to the H'^ semi-norm 

\a.\ — k 

We denote R-''^ = (iJ'^t)* and y-'^t = (y^t)*. it follows easily that ip (r, z) e H^^ 
is equivalent to tp, ip^jip/r € (R'^) . Furthermore, -0 (r, z) G iJ^''' is equivalent 
to i/', V'rrj V'zzj (V'/'')r ^ (iR'^)i ^^d such a fuuctiou also satisfies 0^, i/i^, i/j/r G 
L2 (m3). We also define the space W'^^ = V'^^ n V^^^ with the norm 
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and W "^^ — {W'^^Y . We also denote to be the closure of the functions in 
C^(R'^) with respect to the norm 

\a\=k 

and V-^ = {y^Y- 

As noted by F. H. Lin (see [13]), for any function (r, z) we have 

(54) - A {il^e'^) = e'^ l^d^.Tp ~ drr^ ~ ^a^V + ^V' 

We can apply the usual elliptic regularity theorem to the operator —dzz — drr ~ 
^dr + ^ and the singular factor l/r^ is artificial, introduced merely by the change 
of coordinates. The daggered spaces are designed to take account of this singular 
factor. 

We denote by | I2 the norm in _L| (M'^), by ( , ) the inner product in L| 
by ( , ) the pairing of dual spaces, and by ( ,)|^ | the inner product in L^^ 
where |/Zg (a;, v) \ is the weight with || || |^ | the corresponding norm. We defined the 
operator in the previous section. 



Lemma 4.1. (Properties of Q^) Let < A < 00 

(a) : I (K^) ^ L^^ | (R^) with operator norm = 1. 

(h) For all to G Lj^^ | (R^), \\Q^m - VmW^^ | as A ^ 0, where V is defined 
in the introduction. 

(c) If a > 0, then \\Q'^ — Q°'\\ ~ 0{\\ — cr\) as X ^ a, where \\ \\ denotes the 
operator norm from L"^^ | to | . 

(d) For V — VrGr + vgeg + VzGz, denote v = —VrGr + vgeg — VzBz and n {x,v) = 
n {x, v) . Then ( Q^m, n) |^ | — (m, Q'^'t-) |^ | , for any m,n £ L/^^ 



(e) For all m £ ^ (R^) , \\Q^m - to|| |^ | ^ as A ^ +00. 
Proof. To prove (a), 

(QV?^)i^j = j Xe^' JJ (mv^Mj) (X (s) , ^ (s)) • (nv4^) {x,v)dvdxds 

Moreover, Q^l = 1. 

Assertion (b) was proven in Lemma 2.6 of [23^. As for (c), we estimate 

||Q^m- Q'"to|||^ , < / lAe^^'-cre'^'l ||TO(X(s),y(s))|||„ |ds 









jAe^^'-ae'^^l 


•J —00 










jAe^^'-ae'^^l 


-/ — CXD 





< C|lnA-lnCT| ||m|||^_^| . 

To prove (d), note that the characteristic ODE is invariant under the transfor- 
mation s — > — s, r — > +r, z — > +z, Vr — > ~Vr, vg +vg, Vz —We- Thus 

n{X{—s; x, v), V{—s; x, v)) — h iX{s; x, v), V{s; x, v)) . 
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Now 



(Q^m,n)|^ I = / Ae^" / / \fiJm(X(s),V{s))n{x,v)dvdxds. 



We change variables {X{s),V{s)) {x,v) and {x,v) {X {—s),V{—s)) with Ja- 
cobian = 1 to obtain 

{Q^m,n)^^^=J Ae/'^y" J {x,v) n {X{-s),V{-s)) dvdxds 



' —oo 



Although assertion (e) was essentially proven in Lemma 2.6 of [23], we outline 
the proof here. Letting M denote the spectral measure of the self-adjoint operator 
—iD in the space |, we have 



Q^m-m= f i^^-l) 



dM{a)m. 



Thus 

r \ 

1 



X + ia 

as A ^ +00. □ 



d\\M{a)m\\lj 



Remark 1. Since j'^^ Ae'^^ds = 1, the function 







(Q^m)(x,t;)= / Xe^''m{X{t;x,v),V{t;x,v))ds 

J —oo 

is a weighted time average of the observable m along the particle trajectory. Lemma 
\4-l\ (b) tells us that as \ ^ 0, the limit of this weighted time average equals the 
phase space average. This is the same as the ergodic theorem for the usual time 
average, that is 

lim — / m{X{t]x,v),V{t]x^v)) ds = lim Q^m = Vm. 

In particular, if the particle motion is ergodic in the set Se.p determined by the two 
invariants e and p, and if dae.p denotes the induced TTlGdSUTG OTl S^^p^ thGTL 

1 f 

Vm = — — - / m (x) dae.p {x) . 



For non- ergodic particles, we do not have such an explicit expression, but Vm still 
equals the phase space average of m on the set traced by the particle. 

Lemma 4.2. Let < A < oo. 

(a) maps L^ with operator bound independent of X. 

(b) Ai, A2 and are self-adjoint on L^ with domains H^, H^^ and H^^ 
respectively. 

(c) The essential spectrum of Ai is [Q,oo), while that of A2 and is [A^,oo). 

(d) {A^h, h) >0 for all ^ h e . 

(e) (.4^) ^ maps V^^ into with operator bound < 1. 

(f) For all heL^, {C^ - £°) h strongly m asX^ 0. 

(g) If a > 0, then as A — > cr, the operator norm from to of A2 — A2 tends 
to zero. The same is true of B^, Ai, (^1) ^ and . 
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Proof. Assertions (a), (b), (c), (d) and (f) were proven in Lemma 3.1 of [23] . As 
for (e), let us define A ^ Ai for brevity. Let cj) eV^. Then 



by Lemma ICT aV Denoting h = A4', wc therefore have 

ll^-i/illj,^ = IV0I2 < {A(l),(l)) = {h,A-^h) < \\h\\y_, 
Thus < Finally, Assertion (g) follows directly from Lemma 



Remark 2. The supports are under control in the following sense. Recall that we 
assume /° {x,v) = ^{e,p) has compact support C 5 C Mj^ x M^. We may assume 
S = Sx X Sy, both balls in M.^ . Let x = X (^^ ^) be a smooth cut-off function for 
the spatial support of f^ in Sx', that is, x = \ on the spatial support of and has 
compact support inside Sx. Let be the operator of multiplication by x- Then 



= B^M^ = M^B^ = M^B^M^ 



and the same is true for all the operators , T>^ , S^, T^,[C^) , [D^) , [T^ 
Indeed, 

Me = Me X, v), V{s; X, v)) 

because of the invariance of e and p under the flow. So for example 



{B^h) {x) = -hJ velijv + J fi^Q^ {veh)dv 

^ -h vgfijv + {^i^veh)dv = {M^B^M^h)(:x). 



Below, for any function space Y, we denote by l^c = G F | supp[h) C Sx}. 
Then = = and = H^^ = if^t. By mollification, is dense in V''. 
Furthermore, {H^'^)c C V^'^. The multiplication operator My, maps into H^. 

Lemma 4.3. For any A > 0, 

C\ V\ {T>^Y -.Hll^Ll 

All these operator bounds are independent of X. Furthermore, all these operators 
are continuous functions of X in the operator norms. As X 0+, all these operators 
converge to strongly (but not in operator norm). 

Proof. By the preceding remark, the images all have support in the fixed set Sx 
and the operators act on functions h depending only on x^. Now 

{C^h,k) =11 ven^Q^ {Gxh)xk dvdx 



-{Q^ {Gxh),vexk)^ 
\{C^h,k)\<C\\xh\\Hi,\\xkh^ 



so that 
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with C independent of A. The same proof works for aU of the operators (in their ap- 
propriate spaces), except and {T^)* ■ For = (X>^)* {A^Y^ B^-{C^)* , it fol- 
lows from LemmallSIa) that the operator (P^) * {A^) ^ (V^) * (^i ) B^ 
maps 

Ll, -^Llc HY C ^ Hi CL'^ iJ-it. 

Similarly for (j^^)* . 

The continuity follows directly from Lemma I4.ir c) . Now let us consider the 
behavior as A ^ 0. For any function S -ff^^, by Lemma HTlT b') we have 

C^(j)-^ J veii^V{G(t))dv 

strongly in as A — > 0-I-. Clearly Gcj) is odd in {vr^Vz)- By Lemma 3.3 in [23], 
it follows that V (Gh) is also odd in{vr,Vz)- But vgn^ is even, so that the integral 
/ vefie'P {Gh) dv vanishes. Therefore ^ strongly as A 0+. The proof is the 
same for the other operators. □ 

We study the mapping properties of the operator A^ in the following lemma. 

Lemma 4.4. There exists Ai > such that for any < A < Ai, the operator A4^ 
maps VF^t a one-to-one manner onto Therefore it has a bounded inverse 

fromW^^^ ontoW'^^. Furthermore, (A^) , if restricted to V~'^\ maps 

V^-2t into 

V"^^ with operator bound independent of X. 

Proof. It is convenient to introduce yet another operator ^5 so that 

Al ^ U^A^U^ 

where = (- A + ^ + . Then 

Al^-i^ + ^-{u^)-'g^u^)-\ 

where ^ £^ + {T>^) {Ai) T>^ . We remark that the operator £^ < 0; however, 

this fact is not useful because the other operator {T)^)* (Ai) ^ > so that the 
two signs are in conflict. 

By dMl), for e L| we have 

so that {U^Y^ ■ Lg H^^ and i/^^t ^ 7^2^ We consider the two terms in 
separately. The operator {U^)'^ £^ {^^Y^ = {U^Y^ M^S^M^ {^^Y^ maps 
^2t ^ ^3t ^ ^it ^ ^-it ^ ^2^ 

Since the mapping : H^"^ H^^ is compact, the operator {U^) ^ (^^) ^ is 
relatively compact with respect to — A + Similarly, the operator 

{U^)'' {V^y {A'l)'^V^ {U^Y' = i^T' {T^^T'M^ {^iY't^^^^x i^T' 
maps 

H^f ^ j/3t ^ ^it ^ ^2 ^ H-1 c ^ ^ Hi cLl^ ^ 

and it is relatively compact with respect to —A-\-^. Therefore by the Kato-Rellich 
and Weyl theorems, ^5 is self-adjoint on Lg with domain H^^ and its essential 
spectrum equals [0, -l-oo). 
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We split ^5 into two parts as 
and claim that 

for sufficiently small A. To prove the claim, ffist note that too is self-adjoint on 
L^g with domain H^^ and its essential spectrum equals [0,oo). So we merely need 
to show that the point spectrum of is also contained in [0, oo) for sufficiently 
small A. We prove this by contradiction. If it were not true, then there would be 
sequences A„ \ 0, «;„ > and 7^ u„ G i/^^ such that A^'^Un — — Let 
K = e'^U^^Un- Then ^ e and 

i(-A)(-A + Xl)h,, = e^'g^-e-^'K, - til{~A + Xl)K. 

Because of the support properties of , we can insert the cut-ofF function x freely 
both before and after the exponentials. So if x^n = 0, then 5 (—A + A + 

X^)hn = 0, whence /i„ = 0. Therefore xhn 7^ 0. We normalize ||x/in||\/i = 1. 
By Lemma e**CJ^"e^'^ is bounded from to H^^ uniformly in A. Hence 

(-iA + kI){^A + Xl)K = xe^'Q^-e-'^xK 

is a bounded sequence in H^^. Multiplying this equation by /i„, we get ||/in||y2 < 
C'llx^rillffi < C"||/i„||v2. Thus hn is bounded in V'^. 

Taking a subsequence, we therefore have hn ^ h weakly in V'^. Since x has 
compact support, it follows that x/i„ — > x/i strongly in and that = 1- 

Now for any £ ^ H^, we have 

\{e^'g^-e-''K,£)\ = |(x/i„,e'V"e-^V>| < \\G^"e-'\£\\H-i^ 

since x^n is bounded in V^. By Lemma 14.31 the right side tends to zero as n — > cxd. 
Thus e''^g^^e-''^h„ weakly in H~^. 

Letting n 00, A„ ^ 0, k„ ^ kq, the limit satisfies (— 5A + A)/i — 0, 

where h ^ V^. Since Ah £ L^, we deduce Ah = 0. We do not know that h or 
Vft. belong to L^, but we can use Hardy's inequality (valid for functions in V'^) to 
estimate 

1 

^ J{\x-xo\<R.} \x-Xo\ J 

for every point xq. Therefore /i is a constant. Since h E V^, h = 0. This contradicts 
||x/i||yi = 1, which proves the claim. 

The claim we have just proven means that {AgU, u) > for all u in the domain 
if^t of the operator. Thus 

{A^u,u) >^J {\Vu\^ + ^u^)dx. 

The right side is the squared norm of u in F^^. The left side defines a bilinear form 
a{u, u) that extends continuously to V^^ x V^^ . So by the Lax-Milgram lemma, the 
operator A^ : V^'^ — > V^^'^ is one-to-one onto. 

But A^ = U'^A^U^ ■ Since for fixed A > 0, the operator is an isomorphism: 
VF^t ^ and also y-^t ^ p^-2t^ deduce that A^ maps W^^t to W^-^t 
in a one-to-one onto fashion. It is also clear that |i^||y2t < C||Z^'^/i|jyit so that 



26 



ZHIWU LIN AND WALTER A. STRAUSS 



: V^it ]/2t ^i^i^ ^ ^jQ^^^ independent of A and {U^)-^ : V'^^ V'^^ 
with a bound independent of A. Therefore 

with a bound independent of A. □ 

Lemma 4.5. If S is a ball in M.^ , there exist constants C > and A2 G (0, Ai) such 
that 

{A^u,u) > C||u||^it 
for all u e with support in S and all A G (0, A2]. 

Proof. We argue by contradiction in a similar way to the preceding proof. If the 
lemma were false, then there would be sequences A„ — > and u„ G V'^'^ with 
supports in S such that ||u„||yit — 1 but (^4'*u„,u„) — s- 0. By definition of A\, 

Letting ft,„ = e**u„, we have 

((-A) (-A + A^) hn, hn) - {e''g^-e-'%n,K) -> 0. 

Thus 

WAhnWl. + Xl\\Vh,,\\l. < \\g^"\\mf^H-^A\hnfm + l. 

Because the right side is bounded, we therefore have a bound for Ahn so that 
hn is bounded in V^. Taking a subsequence, we have /i„ ^ Hq weakly in 
and consequently m„ ^ e~'^/io weakly in V'^'' . Because of the uniformly bounded 
support, we can replace V^^ by H^^ and use the compact embedding to deduce 
that Un e~*^ft-o strongly in H^^ . Therefore 1 = ||e^'^ft,o|| vii = ||/io||vi- By the 
strong convergence of m„ in H^'' , and the strong convergence of Q^" as A„ — > 
from Lemma 14.31 we have (Q^'^UmUn) — > 0. Therefore 

((-A) (-A + A^) /i„,/i„)->0. 

So hn tends to zero strongly in and so also in (due to the bounded support), 
which contradicts ||/io||yi =1- Q 

It follows immediately from either of the two preceding lemmas that My^{A\)^^ 
maps into H^'^ with a bound independent of A. 

5. Behavior for small A 
Lemma 5.1. There exists A3 > such that for any A G (0, A3] the operator 

is self-adjoint on with domain H^^ and has essential spectrum [A^,oo). More- 
over, if has a negative eigenvalue, then Af^ also has a negative eigenvalue. 

Proof. The bound A2 is given in Lemma H75l By the proof of Lemma 3.1 in [23], the 
operator is relatively compact with respect to — A + + A^. By Lemmas 14.31 
andlMl the operator (T^)* {A^y^ = ■ {T^)* ■ {M^ (^4)"^ M^} ■ ■ 
maps 
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which imphcs that it is relatively compact with respect to — A + I/t-^ + A^. So the 
self-adjoint and the essential spectrum properties follow from the Kato-Rellich and 
Weyl theorems. 

Assume now that £° has a negative eigenvalue < and let G H'^^ be a 
normalized eigenvector. Write 

By Lemma [4.2f f ). the first term on the right is less than \\{C^ — £") C'^||i2 ^ 0; 
as A \ 0. By Lemma H31 the second term is bounded by 

< C||j^^C°||^-it ^ asA\0 

because C is independent of A, and using Lemma [131 Thus (7V^C°,C°) ^ fc° < 
as A \ 0. So if A3 is small enough and < A < A3, then A/''*' has a negative 
eigenvalue. □ 

Now we perform a finite-dimensional truncation of the matrix operator (|53p . Let 
{cti, tT2, • • • } be a sequence of functions in for which the finite linear combina- 
tions are dense in y . Orthogonalize them so that they form an orthonormal set 
in L|.. As before, ( , ) denotes the usual pairing and we will denote the standard 
inner product in R" by a dot. Let n be a positive integer. Define the projection 
operator P„ : F^^t ^ jgn ^nd its L^-adjoint P* : M" ^ l/^t by 

n 

Pnh^{{h,a,)};^, , P,:6 = ^5V, , 

where h e V^^t and 6 {b\--- ,6") E M". Then P„P*^ = b for any 6 e M", 
and P*Pnh = i^^'^j) '^j ^'^^ ^ ^ Define the "approximate matrix 

operator" 




which takes F^t x E" into L| x W\ 

Lemma 5.2. Lei < A < A3. For any r] e -Lf^^, define dn = {PnA\P*)~^ Pn^^rj ■ 
Then 

sup ||P^d„||i/2t < Qo. 

n 

Proof. Because A is fixed, for brevity we denote A — A\ and J- = . Note that 
a — PnAP* is the n x n symmetric positive-definite matrix with entries ajk — 
{A4<Jk,crj)- Let c{n) — ||x-P,t^nl!_f/it • We will show that c(n) is bounded. Suppose 
on the contrary that c(n) 00. Let Un = P*dn/c(n) so that HxMnllffit — 1. Then 

PnAUn = PnAP*dn/c{n) = Pn^pT] / c{n) SO that 

(Av>n:'^n) — (AUm } — 7 \ PnAUji ' dji 

c(n) c(n) 

= . Pn^V ■ dn = -^{J^r],Un). 

c-^(n) c{n) 



< 



{A 
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Thus 



-A + -^^ ^-A + ^ + A^^ Un, = {G^Un, Un) + X"") 



SO that, as in the proof of Lemma 14^ 

||u«li^2t < CllxUnll^it + -^llxUnllffit < C+ 1. 

We take a subsequence so that m„ ^ uq weakly in VF^^. Then x'^n X'^o strongly 
in so that ||x^io||Hit = 1- Fix an integer m > 1 and let n > m. Then 

Pn^m = Cm, whcrc (i5m)j = 1 for i — m and is otherwise 0. Then 

{AUn, Cr,n) = PAUn ■ 6,n = -^Pn^V ■ S^n = -^{Tl], (J,n) 

c[n) c[n) 

as n — > oo since {Trj^am) is independent of n. Thus {Aui^,am) — for all m, so 
that Auq — 0. So Wo = 0, which contradicts Hx^ollHit = 1- Thus c(n) is indeed 
bounded. 

Now substituting u„ — P*dn/c{n) into the inequality above, we get 
1 C 

\\-r^Pndn\\w^i = ||u«||^2t < C'llxMnllffit + "r^llX^nlUit 
C( T}/ ) CI yT< 1 

Multiplying by c^(ri), we find 

||P„*d„||^2t < C^||xJ^„*dn||?^it + C||xP„*d„lkit = Cc'in) + Cc{n) < C . 

Therefore P*dn is bounded in W'^\ hence in V'^^ . □ 

Lemma 5.3. Fix < A < A3. There exists a positive integer N — N^X^) such that 
for n > N, the matrix operator 

" V Pn^^ -PnAlP* 

is self-adjoint on L| x R" with domain H^^ x M", has essential spectrum [A^,oo) 
and has at least n + 1 negative eigenvalues. 

Proof. We recall that is self-adjoint with essential spectrum [A^,oo). However, 
the symmetric operator 

' (^^)*p,: 

has finite-dimensional range and so it is compact. The theorems of Kato-Rellich 
and Weyl's apply here directly to prove the first two assertions of the lemma. It 
remains to consider the negative spectrum. 

The last assertion is equivalent to saying that there is an (n+ l)-dimensional 
subspace S C H^^ x M" such that (M^z, z) < for all z e \ {0}. For simplicity, 
we temporarily drop the superscript A as it is fixed in this proof. As above, let a 
be the n x n symmetric positive matrix with entries ajk — {A^ak, (Tj). Let 



Then 



/ 

a-^PnT I 
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has the same number of negative eigenvalues as A^n- But —a has exactly n negative 
eigenvalues, so it suffices to prove that 

has a negative eigenvalue when n is large. 

By Lemma [5TTI the untruncated operator U = C + {!F)* (^4)^^ !F has a negative 
eigenvalue. Let 77 = 77'*' be an eigenvector oi M ^ as in Lemma 15.21 with 
eigenvalue /i < and ||?7||l2 = 1- Let = A^^Trj. Since 77 g L^, we have 
^-"77 € H^"^^ and ^ € V'^'^ . Recall that d„ — a^^Pn^i]. By these definitions, we 
have 

(AA„77 , 77) - (AA77,77) 
= {{T*P:a-^PnT - T*A^'T)v, v) = {{P^a-^PnT - ^1^.^)77, Tr,) 

= {p:dn - AS = {Aiipy^ - 0, 0- 

Choose a sequence f„ such that — Clly^t and such that each ^„ is a 
linear combination of {cti, . . . , (t„}. Then ^„ belongs to the range of P*. Because 

PnA4{P*dn - = (^dn - Pn^V = 0, it foUows that 

|(AA„77,r7)-(AAr;,77)| = |(^4(P„*d„ - - Ol 

< P4(P,:d„-e)lk-t|ie-ej|y-r 

< ci|p,:d„-cik2tiie-ejiv-f 

< c'lie-ejk-i- ^0 

as n — > oo. Since {Afri,j]) < 0, it follows that (A/'„7/,77) < for sufficiently large n, 
so that J\fn must have a negative eigenvalue. □ 



6. Approximate growing mode 
Now we consider the behavior for large A. 

Lemma 6.1. There exists A5 > such that if X > A5, then for each n the operator 
has at most n negative eigenvalues. 

Proof. For h e H'^\ 

{£^h, h) > {A^h, h)= (^-A +^ + X^^h,h^~ jj rvgfipdv \h\^ dx 
vet^eQ^ i^eh) dvhdx. 
The last term is bounded by 

{Q^{ieh),vgh)^^^^\ < \\vgh\\l^^ < (^sup J d«) \h\l 
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byLemmaEKa). Thus {£^h,h) > (A^ - Co) |/i|2, where Co = sup^ (/ (|r^p| + |/ij) 
Now for any {h, b) £ iJ^t x M", 

( ' ( ) ^ (^'/^^ h) + 2 P^b) {AlP^b, P^b) 

> (A^ - Co) \h\l - \\T^h\\^_,, \\xP:b\\H,, - C (A) ||P,:5||^.t 

> (A^ - Co) \h\i - 2Ci \h\^ \\p:h\\y., - c(A) \\p:mU 
>-(ci + c{\f)\\p:h\\i., 

provided A > A5 = VCo + 1- Since & e M", it foUows that M.^ has at most n 
negative eigenvalues. □ 

Now we are ready to exhibit an approximate growing mode. 

Lemma 6.2. For each positive integer n > N{X3), there exists A„ G [A3, A5] such 
that Mn" b,as a nontrivial kernel. Here A4, A5 are in Lemmas \5.3\ and \6.1[ 

Proof. We emphasize that A3 and A5 do not depend on n. We use continuation in 
A. First, Ai^ is a continuous family of operators of A in the sense that if cr > 0, 
then there exists C,5 > such that 

<C|A-a| 

for |A — ctI < S, A,ct e (0,00) , where |||| denotes the operator norm from L| x M" 
to L| X M". This continuity property follows immediately from Lemma [42l 

By Lemma [5.31 M^'^ has at least (n + 1) negative eigenvalues. By Lemma [6.11 
has at most n negative eigenvalues. By ([13, IV-3.5), the eigenvalues of 
within the interval [A4, A5] are continuous functions of A. In particular, the dimen- 
sion of the corresponding eigenspace is a constant, hence at least one eigenvalue 
must cross from negative to positive. So there exists some A„ € [A4, A5] such that 
Mn" t'as a nontrivial kernel. □ 

7. Limit as n — > +00 

Lemma 7.1. There exist Ao, ho, ko such that < Ao < 00, ho E ko E H^^ 

and 

(55) C^"ho + {T^")* ko = 0, 

(56) T^^'ho- A^''ko = Q 
with {ho,ko) ^ (0,0). 

Proof. By Lemma [6?2l for each n > N{X3) there exists A„ G [A3, A5] and a nonzero 
solution {hn,bn) e i?^^ X M" such that 

(57) £^"/i„+(.F^")*P„*6„ = 0, 

(58) PnT^-hn-PnAl"P:b„^0. 
We normalize ft,„ , 5„ such that 

\\hnh2 + \\xP:bn\\H^,=l 

by Lemma [4.51 We claim that hn is bounded in H^^ . In deed, ||x-Pn^n||//it ^ 
1, so that i^T^")* P*bn is bounded in L^, and C^"hn is bounded in L^. Since 
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1 1 1 1^2 < 1, {B^")* yAi"j B^"hn is also bounded in L^, and so are A2"hn and 
(—A + ^ + Xn) Ki- Therefore /i„ is bounded in H'^^ . By ([55)1 we have 



The right side of this equation is bounded. So {{-A+-l^){~A+-ij + Xl)P*bn, P*bn) 
is also bounded. Therefore P^bn is bounded in y^'I'nF^^. Now we take subsequences 
such that A„ ^ Ao S [A4, A5], /i„ ho weakly in Pn^n weakly in V'^'^ . 

We look at each term for ([ST)) . (|58|) separately. First, for any I e H'^\ 



< 



I {C^« {K - /^o) , 1 + I ((-C^" - -C^") I) I 



< \ {{K-ho),C^"l)\ + \\C^- - C^''\ 



as n ^ 00, by Lemma 321 Thus C^'^hn — > C^°hQ weakly in '^K 
Secondly, for any / e L5, 

{T^-y p:bn~{T^'^y ko 



< 



Aol 



as n CX3 by Lemma 1431 Thus (j^^")* ^ (J^^")* fco weakly in L|. 

Thirdly, for any g G i?^^, let gn = X]j=i ^ 9 strongly in iJ^^ as n ^ 00. 
Let 7„ = {cJ}^^ e M". Then P*7„ = 5,, and (P„.F^"/j„, 7„) = (.F^"/i„, g„) . 
Hence again using Lemma l4?3l 



\{P„T^-hn,j„)-{T^"ho,g)\ 

< I ( (.F^" - ) /i„ , g„) I + I K , 9n -.9)1 + 1 {^^" (hn-ho), g) \ 



Aol 



< Ci - ^^ii^^^-it ll'i"|lL2 ||.g||ff2t + C2 WKWl- \\9n - 9\\m^ 
{K~ho),{T^'>y g) 







as n ^ 0. Thus (P„J^^"/i„, 7„) {T^»ho,g) for aU g e ff^t. 
Fourthly, using the same g € ff^t as above, 

p„^^p,:6„,7„)-(^^fco,5) 

(^^•P„*6„,5„)-(^^fco,5) 

( (^^' - P„*6„, g) I + I (^^P:6„, ff„ - g) I + I (p:6„ - fco) , 5 



< 



= 1 + 11 + III. 
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The first term on the right is estimated as 

/< (A^,-A^)||P„*6„|l^,t llsllyit 

+ 11^^" -e^"L,t^ff-it \\xP:bn\\m^ \\X9\\m^ 
^ , as n — > oo, 

where 



By Lemma r4.4| 



< C, so 



^4 

II <C \\P*bn\\v2i hn ~ g\\v2i 0, as n ^ OO. 
As for the third term, Al°g G H^^^ so that 



/// 



iP:bn-ko),A^"g) 



0, as n — !■ oo. 

So (^PnA4"P*bn,-fn) (-44^0,5) for all g e H^^ . Thus aU four terms in ([57|. 
([55)1 converge and the limits satisfy ([55]) and ([55)1 . 

It remains to show that (/io,fco) 7^ (0,0). Let us write (|57p explicitly, using the 
definition of /I"^" , as 

(-A + A^) (e'«/j„) = (-A + ^ + A^) /,„ = /„, 

where 

+ e'' J vgfi^ (ve h) dv - e'" (S^" ) * ) " ' S^" /i„ . 
By Lemmas 14.21 and I4.3[ /„ is bounded in (M?^ and has support in the fixed 



bounded set Sx C M'^. Therefore the inversion of the operator (—A + A^^) with A„ > 
A3 > implies that /i„ decays exponentially as |a;| — > 00 , uniformly in n. Thus {/in} 
is compact in L^, so that ft,„ — > /iq strongly in L^. Since ||f'^&n||y2t is uniformly 
bounded, xPn^n X^o strongly in H^'^ . Therefore, we have ||ft'o||j;,2 + ||x^oll_f/it = 1 
and so (/io,fco) 7^ (0,0). □ 

8. Growing mode 

Changing notation, Ae = h^, n — ko, and replacing Aq by A, we have from ([55]) 
and (j56p the pair of equations 

(59) L^Ag = - {J'^Ytt, A^n = J'^Ag 

where {Ag,TT) ^ (0,0) , Ag G tt e i/^t^ A e (0,+cx)). We must define /, and 

A so that (IMl), dSS]) and ^ are satisfied by e^* (/,(/), A). Indeed, motivated by 
Section 3, we define 

Ar = -d,T:, A, = ldr{r'K), A = {A^, Ag, A,) , 

(60) <l>={Aiy\B^Ag+V\), 
E==-V0-AA, B==VxA, 
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and 

(61) / (x, v) = -fi.cp + ^i.Q^cj) - ^ipvAg - fi^Q^ (vgAg) - fi^Q^ {Gtt) . 

It follows directly that V • A = 0, A e H\ (/) E V\ E e L^, Be L^, Ag e L°° 
and by Lemmas [42l lU and [HI f e L'^ [M.^ x R^) . 

Lemma 8.1. The Poisson equation — A0 = p is satisfied. Moreover, (f> E (K."^) 
and f e L°°(M3 X R^). 

Proof. By (|60)) . we have Ai4> = B'^Ag + V^tt, which is written explicitly as 
-A^ = ( / /igdw ] (f)- p.^Q^(j)dv - ( / vgfi^dv ] Ag 



+ J MeQ^ iveAe)dv + J ^i^Q^ {Gn)dv. 

On the other hand, by (|6ip and J {rUp + weMe) — ^^ S^^ exactly the same 
expression for p = — J fdv. Now integrating (|6ip in w and a;, we find that the 
first and second terms cancel, the third and fourth terms cancel, and the fifth term 
JJ/ig Gn dvdx vanishes by the oddness of the integrand in {vr,Vz). Thus J pdx = 
— J J fdxdv = 0. Furthermore, p has compact support. So by the proof of Lemma 
3.2 of [23], (j) G L"^- Since p € L^, by elhptic regularity we have </> G C L°°. 
Moreover, 

= T^Ag+S^TT+iV^YiA^y^V^Tr e H-^^ 
so that TT e and Gtt G L°°. Therefore from ([H]), / € i°°(M^ x R^), □ 

Lemma 8.2. The function f defined by i61\) satisfies I138\) . 
Proof. We have 

/ = -p,cb + ^l,Q^c|) - fi^rAg - fi^Q^ {v-A). 

To show that / is a weak solution of ([55]) . we take any g E (R'^ x M'^) , and 
compute 

(Dg) fdxdv 

{Dg) (-Me'/') dxdv + [[ [Dg) p^Q^<j)dxdv 

{Dg) {~p.prAg) dxdv -II (Dg) p^Q^ [v ■ A) dxdv 

= I + II + III + IV. 
Since D is skew-adjoint, the first term is 

I — gD {Pg4>) dxdv = p^gD(j)dxdv. 

Similarly, 



/// = / / fJ-pgD {rAg) dxdv. 

JJR3xR3 
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By definition of Q, 

11= Ae^* // fi^ Dg{x,v) (f>{X{s;x,v))dxdvds 

Xe^" II fi^{Dg){X{-s),V{-s))(t){x)dxdvds 

/i, / Ae^'' (^("''')' ^(-'^)) ) W '^^^^ 

Me <{ -Ag (x, i;) + / X^e^'g {X{-s),V{-s)) ds )■ (j> (x) dxdv 

oc 

2„As, 

R3xl 



^i^X(j) (x) + Me / A^'e^^c/) {X{s),V{s)) ds S- g {x, v) dxdv 

= X {— /ig</) + /igQ'^f/)} g dxd-y. 

The preceding calculations are valid since belongs to and thus is continuous. 
Similarly, 

IV ^-X II {-fi^v ■ A + fi^Q^ {v ■ A)} g dxdv. 

So we have 

/ / (Dg) fdxdv 

J JM^xR^ 

= 11 X{-^i^(j) + ^j,^Q^(j) + ^i^Q^ {v ■ A)} g dxdv 
+ // {fi^Dcj) + fipD (rAg) + X^^ij ■ A} g dxdv 

{A (/ + fipvAe) + + ^pD (rAe) + Xfi^v ■ A} g dxdv. 



So / satisfies weakly the equation 

(A + D) / = -ii^D<j) - ^ipD {rAe) - XfipvAe - Xfi^ii ■ A 
which is exactly p8|) . □ 



Lemma 8.3. Denoting p = — J fdv and j = —Jvf dv, we have the continuity 
equation Ap + V • j = 0. 



Proof. By the last lemma, / satisfies (|38)) weakly, which can be written as 
(62) A/ + V:, • {vf) - Vi, • { (E° + E'^^* + vx{B° + B*=^*)) /} 

= -V, •{(E + z)xB)/°}. 

The last equality follows in the same way that ([55)1 was derived. Let ? {v) S (M^) 
to be a cut-off function for the ti-support of fi{e,p). Taking any h {x) G (E.^) and 
using <; (v) h (x) as a test function for (p^ . all the terms coming from ^-divergences 
vanish and we have 

J Xp {x) h{x)dx — J j • Vhdx — 0. 
So Ap + V • j = weakly. □ 
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Lemma 8.4. The Maxwell equation is satisfied. 
Proof. By (l6Tt . we have 

+ (^J vupdv^ rA0+ J vfi^Q^ {v0Ag)dv + J v^^Q^ (Gtt) dv. 
Its ^-component can be written as 

je = - (B^) * - A^Ag +(^-^ + ^ + }?^Ag+ C V. 
By the definition of 0, 

- [B^y = _ {B^y {A'ly' b^Ao - {B^y {A'ly' v\. 

By the definition of 

-A^Ag = -L^Ag + (S^)* [A\y^ B'^Ag. 

By 

-c}Ag = [T^yi, = {B^y {A\y^ v\ - c\. 

Adding the last three equations, we obtain 

- {B^y (P - A^Ag + C^TT = 0, 

so that 

jg ^{-A + j, + A') Ag 

and 

jgeg = (A^ - A) {Ageg) . 

Because Wcj) has no 0-component, this result is the 0-component of the Maxwell 
equation (^0]) . 

It remains to derive the r and z components of ([^0]) . By ([55)) . ([50)1 and (pT|) . it 
follows exactly as in the proof of Lemma 13.11 that 

(-A + Jj) (-A + + A^) TT - {V^y - (C^) * Ag + £\ 
As in that proof, we introduce K = jr^r + jz^z and I = (— A)^^ K. Then 

(-A + J^) (-A + + A^) ^ = (-A + ^) {dzir - driz) 

so that 

{-A+^+\^)^^dzIr~drh. 

This result can be rewritten as 

(A^ - A) (Tree) = V x I. 

Taking the curl of both sides, 

(A^ - A) [ArBr + AzGz) = -M + V (V • I) . 

But 

V • I = V • (-A)"^ K = (-A)"^ V • J = AA- V = 

so that 

(A^ - A) {ArBr + Azez) = K - AV(/i. 
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In components, this means 

(A^ -A)Ar^ Jr - Xdr^ , (A' ' A) A, = J, - Xd,(j) , 

which are precisely the r and z components of ((40|) . □ 

This completes the proof of Theorem 11.21 (i) . To prove Theorem 11.21 (ii) on the 
number of growing modes, we first note that for each n— truncated problem, it 
follows from the continuation argument that the number of approximate growing 
modes is bounded below by the dimension of the negative eigenspace of Since 
we have the uniform control of the converging process as n — > cxd , the lower bound 
for the number of exact growing modes follows. The proof of the upper bound is 
the same as in the l-^D case and we omit it. □ 

Remark 3. In this 3D case we do not have much regularity of f and the growing 
mode is only shown to satisfy the linearized equation weakly. This is mainly due to 
the complicated behavior of the SD particle trajectories. To see this difficulty more 
clearly, we formally differentiate f given by i61]) and look at a typical term 

/igAe"^* {^{s', X, v)) — — dxdvds. 

ov 

If the stretching factor g^^'"'* grows like e"^'^' with a > X, the integral diverges and 
we lose the differentiability of f . In the l-^D case it is possible to prove (see [24J 
some regularity of f by estimating an averaged Liapunov exponent for the quantity 
1 1 ^'^'^^'^'^^ dxdv. This idea was first introduced in the ID Vlasov-Poisson in 

|22j and it works for integrable trajectories. However, the 3D trajectory in general 
is non-integrable so that the idea fails. For this reason we have had to study the 
operators (C^)*, (T)^)* , and A\ with ranges in negative Sobolev spaces. 

We note as well that the non-integrability of trajectories is the main reason for the 
difficulty of passing from linear to nonlinear instability. 



9. Non-monotone Equilibria 

In case /ig changes sign, it does not seem possible to extend the methods of 
P5] to get linear stability. However, we can still get sufficient conditions for linear 
instability by extending the matrix formulation of this paper. If /ig changes sign, 
we will reformulate the growing mode problem as a 3 x 3 matrix operator Ai^ 
depending on a positive parameter A > and then look for the change of the 
signature of A^'*' as A goes from to +oo. 

In the discussion below, we illustrate this idea only for a simple case, namely a 
purely magnetic equilibrium of 1\D RVM system with two species. Assume now 
that 

(63) /i+(e,p) = ^"(e,-p). 

Then an purely magnetic equilibrium is obtained with electric potential (jp = G and 
magnetic potential ifP satisfying the ODE 

92^° = 2 / V2li-{{v),V2-ij\x))dv. 
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We use the same notation as in [23] and [24]. Define 

A°h = -^dlh - (^j 2fi-dv^ h + j 2^jL- r-h dv, 

Ah = -dlh - j hf^pdv^ h- J 2n-V2V~{v2h) dv, 







p , ^ 

f^e (^i)) d,vdx 



where V is the projection operator of Lf onto kcr D and D — vidx — 



V2B°dy^ + viB^dy^. Denote by n (yl") and n (^2) ^hc number of negative eigen- 
values of Ai and A2 ■ 

Theorem 9.1. Consider a periodic purely magnetic equilibrium as above. Assume 
ker^5 = {0}- Then the equilibrium is spectrally unstable if either 

(i) f<0 and n {Al) ^ n (yt^) . 

or 

(ii) /o > and n {A^) + l^n {A^) . 

Proof, (sketched) As we are merely sketching the extension of our results to this 
case, let us take just one species and use the notation in Section 2. Finding a 
growing mode e'*'' {f,Ei,E2,B) with A > is equivalent to solving (|29|) . ( [30]) and 
([3T|) for {(j),ip,b) where {4>,ip) is the electromagnetic potential and 6 G M^. We 
define the rank-one operators C^, : ^ L% by (b) = bb^ and (b) = bc^. 
Then {(p, ip, b) satisfies the matrix equation 

-A', \ / \ / \ 

{c^y -{v^y ~p{x'-i^) J \ b J \ b J 

This 3x3 matrix A^'^ is different from the 2x2 one of the previous sections. Notice 
that A^'^ is formally self-adjoint. 

Let us look at the asymptotic behavior of Ai^. As A ^ +00, we can show that 
the off-diagonal terms B^, C^, ^ and A^ > 0, by noticing that 

lim / Xe^'h{X{s))ds h{x) 



strongly in Lp, which is the analogue of Lemma [4. If e). We also have A2 > for 
large A. As A \ 0, we have C'*', ^ as shown in the proof of Lemma [2.61 
Moreover, it was shown in Lemmas 4.2 and 3.1 of [23] that for a purely magnetic 
equilibrium, B^ ^ strongly as A \ 0. So A^"^ tends to a diagonal operator as A 
tends to and the same as A tends to 00. Now A^, A2 and tend to A^, A2 and 
Z° as A \ 0. 

We want to show that has a different signature for small and large A. For 
then a continuation argument should ensure the existence of a nontrivial kernel for 
some A4^. However since A4^ is not bounded either from below or from above, 
in order to make the argument rigorous we must truncate as in the 3D case. We 
truncate the ^-component (but not the other components) to an n-dimensional 
subspace which does not spoil the negative space of Ai; that is, we project onto 
the lowest n modes of Ai- We denote the resulting truncated matrix operator by 
Mn- Then for large A, say A > A, has n -I- -I- 1 negative eigenvalues. In case 
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/° < 0, M" has (n - n{Ai)) + + 1 negative eigenvalues. In case 1° > 0, M° 

has (n — n{Ai)) + n{A2) + negative eigenvalues. Therefore and have a 
different number of negative eigenvalues in both cases (i) and (ii). By continuation, 
M'^ has a nontrivial kernel for some A > 0. Then we let n go to +oo to obtain a 
nontrivial kernel for Al'^. As the details are somewhat similar to the 3D cylindrical 
case, we omit them. □ 

For purely magnetic equilibria, in case /x^ < 0, we have Ai > and /° < 0. In 
this case, it was shown in [23j that n {A2) 7^ is the sharp condition for linear 
instability. So Theorem 19.11 is a generalization of that instability result to the case 
of a general purely magnetic equilibrium with nonmonotone /i. Moreover, it was 
shown in [24j that these linear instability results imply nonlinear instability in the 
macroscopic sense. 

For the 3D case with /ig of general sign, one can also use the same idea. The 
equations (|45|) . (|47)) and (|48|) for (</), ^e,7r) can be rewritten as 

B 
I2 





A^ \ \ Ao \ =M^ \ Ao \ = 0. 



A 



Again A^'^ is formally self-adjoint. By studying the difference of the signatures of 
Al"^ at and at cxd, one can obtain sufhcient conditions for linear instability of 
general equilibria, which will generalize the instability criterion of the monotone 
case. However we do not pursue the details here. 

10. Appendix 

In this appendix, we list some common formulae in the cylindrical coordinates. 
Assume ip — ip (r, 9, z) is a scalar function and A = {Ar,Ag, A^) is a vector function. 

^ ^ dip 1 dip dip 
Vip = — + --^ee + -^e^, 
or r oO oz 

1 a / dip\ 1 d'^ip d^ip 
" r a^ V 9^ J ^ r^'de^ ^ 'd^' 



r Or r 89 dz ' 
VxAH-^-^le.+ r^-^le.+ ri^-l^)e. 



r 89 dz J \ dz dr J \r dr r 86 
AA = [^Ar - ^Ar - j e,. + [^^Ae - -Ae + j e, + AA.e, 



We now present the derivation of (j38p in detail. The linearized Vlasov equation 
can be written as 

5t/ + i?/=(E + t)xB).V,/0. 
Since f'^ — fi (e,p), we have 

So 

= -/ieW • - • dtA - fj,prdtAg 
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Moreover, 

vxB-V^f = {v X {V ^ X A)} ■ {fi^v + fipvee} 
= r^ip{v X (Va; X A)} • eo 

= -l^p {vrdr (rAe) + v^d^ (rAe)) = -^pD{rAg). 
The last line is a consequence of the identity 
V X (Va; X A) • ee 

, ( dAg fdAr dAA I d (rAe) ,, 
[Vrer + vgeg + w^G^) X — — + ^ eg H \ \ - eg 



dz \ dz dr } r dr 



, 1 d{rAe) ^ dAg I ^, , , 

= Vz-— = -D[rAg). 

r or oz r 

Combining the above computations, we obtain ([55]) . 
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